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Abstract 

The free energy and finite size effects are calculated for the system of 2 Derrida's 
models with fixed constraint between the spin configurations. Calculation were performed 
for the Random Energy Model approach. 



The random energy model (REM) was considered in [|TJ, where it has been derived 
from the hamiltonian of random P-spin interactions. It has been solved directly in [1]. 
Then Gross and Mezard [2] solved Derrida's P-spin model by means of mean-field method 
(Parisi ansatz for replica symmetry breaking). This 2 models are the same in the ther- 
modynamics limit. Perhaps accuracy is even better, exponential for the good choice of 
P (P=N/2) [3]. 

It is possible to use Derrida's model for the optimal coding [4-7]. This Idea of Sourlas was 
applied to the ferromagnetic phase of Derrida's like model, which gives optimal coding 
for the simple symmetric channel. 

To consider simple case of multi-terminal systems (the case of correlated sources) we 
need to consider system of 2 models of Derrida's, with fixed correlation among their spin 
configurations. In this work we are going to give REM version of such model. 



Let's consider 2 sets of 2 N energy levels El, El 1 < a < 2 N ; E = El + Ej. In addition 
not all the pairs El, P| are permitted. 

The matrix of connectivity a p was introduced, which elements takes the value 1 in 
the case when the pair (E a , Ep) and O-otherwise. 
The energy levels E\ have the distribution: 
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and for Et the distribution is: 
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For the free energy we have an expression 
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P x (El)P y (El); M = 2 N (3) 



There is a condition for the matrix C a i- 
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E^ = ^ hft ; a = l,...,M. 
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By using the trick from 

oo oo 

In Z = r'(l) - An Zde~ tz = T'(l) - / ude~ eUZ (5) 

o — oo 

one gets (Ai = Ny/Jl; X 2 = N^ffiJ) 

oo 

< InZ >= r'(l) - J ud$(u) (6) 
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where 



oo 
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In the bulk approximation our monotonic function ^(it) is similar to step function (with 
the center in the point uq, will be defined later) and one derives 

\nZ~-u (8) 

For u > —Uq the function $?(u) decreases exponentially, and for u < —u it takes 1 with 
exponential precision. Depending on the values of Ai, A2 we obtain different asymptotics 
for the function: 

^ = f dxd V c -(x*W)-eH^+ X W) (g) 
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—00 

In the case \u\ — > 00 we have 2 possiblities. 

At first we can expand the last term in the exponent. It yields: 

*i(u) ~ 1 - e u+(A i +A ^/ 4 (10) 

The main contribution ([H]) comes from the domain near to the point: 

For the calculation to be self-consistent, exp [u + (Xix + X^y)] must be small in the point 
(p!l|). Hence one gets the condition: 

u<-(Xl + X 2 2 )/2 (12) 
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Doing the same for all the degrees of freedom, we get: 

^ (u) — exp 



_ p u+^2-+N ln2(l+h) 



(13) 



Hence as in (||) we obtain: 
\nZ Xj + X 2 



N 4 
The condition (|T2"D yields: 



2 + ln2(l + h) = (l + J 2 )— + ln2(l + h) 
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B < B r = 2\ 



[l + h) In 2 



(14) 



(15) 



1 + J 2 

Now let it be the situation, when e u + x i x + x 2V j s big j n the region, giving the main contri- 
bution to the integral. Then: 
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where the convex domain D is obtained from the condition: 



Aix Q + X 2 y/3 < -u 



(17) 



The value of the integral ( |T6| ) will be defined by the point on the boundary D, where 
( x a + Va) is minimal. 
For that point we get: 
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For one pair it'll be derived (omitted pre exponents): 
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The same goes with 



\I/ (w) ~ exp 



+jVln2(l+fc) 

-e i + 2 



Hence we get (for B > B c ): 
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(A? + A|)iV(l + h) In 2 = BiV*/(l + h)(l + y 2 ) In 2 
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For the general case for ^i(u) we have the expansion: 

+°° - x 2 r ,2 \2 \ 

yj u ) « / dx"-^ 1 - 0(-u - Xxx - ^) e «+^+ A i/ 4 - 0( u + A^ + ^) e -(«+A^) 2 Al 
7 V 71 " I 2 2 J 

(22) 

By taking the integral for one x a and 2 Nh of yp connected with it, we get the 2 Nh power of 
the expression in the braces in (of) (P2|) . This yields to the truncation of the integration 
domain in fl2~2"|). Depending onAi, A 2 we get: 
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If we raise (PB"D, ( |2~4"D to the 2^ power we obtain the expression for \I/(m): 

\^(m) ~ exp 



-N In 2 



or 



\P (it) ~ exp 



- (u+ A 2 -~/Nh\n2/\\ +N\n2 



Hence we find, that for 2Vhi2 < B < 2Vh\n2/J 
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and for /? > 2VMn2/J 
In ^ 



2„,2 



— = xiViV ln2 + \ 2 Vh\n2 = pVh^2^- + h\n2 



The solutions (gjj) , (|28l) are correct for 
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(28) 



h > J 



(29) 



and for 



h < J 2 



(30) 
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the solution is (|2T| ) At high temperatures we have paramagnetic solution (14). Then, in 
the case (30) system falls into SG phase (21) at B = B c . 

In the case (29) we have a mixture phase (SG+paramagnetic)(27) and SG-(28). Now 
let's consider the ferromagnetic variant of the models. 
For E\,E\ we have (instead of ([[])) and (||): 
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VtiN 
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exp 
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-{E\ + JlNf/J 2 N 
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For other E^, E\\ a > 2 we have the old distributions (0),© 
The constants Jq, and Jq are positive. 
In this case for ty(u) we obtain: 



(31) 
(32) 



I -q dx a dy a ^ J _ J2{ x 2 a + yl) - {exp [u + U\ + u 2 + Ai^i + A 2 y 2 ] 
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- ^2 Ci/3 ex P [u + ui + Aix + A 2 y] - ^2 Caaexp [m + u 2 + Xix + X 2 y] - 

P a 
AI 

- c w ey -v \ u + + ^y}} } ( 33 ) 

a,P=2 



where 



Ui = JlBN u 2 = JqBN 



(34) 



For the ferromagnetic phase the first term in braces in (|3^) is resolving. In the bulk 
approximation the three others can be neglected, and then $?(u) behaves like a step- 
function in the point -(Jq + Jq)N b , to the right from this point it damps like: 



exp 



u 



Hence we come to: 



< ^ >= (A + Jl)Ns 



(35) 
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This solution is correct, when it's bigger than the corresponding expression for the spin- 
glass and mixed (one system is in ferromagnetic phase, the other - in the spin - glass). 
Mixed phase is derived, when in braces in ( |3~3"D the second and the third terms are 
dominant. Then we get: 

h) Z JqN b + BVhln2J 



or 



N 

< InZ > 

N 



J 2 N B + By/h In 2 
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In the case fl29|) we get the following condition for the existence of the solution (J3( 



Jo 1 + J 2 > VhT2 + y/h\a.2J 
Jo 1 > y/h\n2 
J 2 > Vh\n2J 

If we have the variant ( j30|) for existence of (|36|) we get: 



(39) 



Jo + Jo > v m2 (l + + J 2 ) 



Jl > Vh\n2 
Jq > VhhPlj 



(40) 



Let's consider now the finite size effects. For the calculation of the magnetization we 
come to the expression: 



+oo 



^> 2 (u)du 



(41) 



ndx a dy 
— - — exp 



7T 



[ x a + vl) + u + «i + u 2 + X 1 x 1 + X 2 yi- 



-{exp [u + ui + u 2 + XiXi + X 2 yi) + ^2 CV ex P [u + u 1 + XiXi + X 2 yp] +(42) 
+ Co2exp [u + u 2 + XxXa + X 2 yi\ + C a pexp [u + X x x 2 + X 2 y ]} 

a a ,/3 

If we neglect the three last terms in braces in the integral in (|4*2]) gives 1. 
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The correction terms in the exponent leads to that (|4"2"| ) is substituted by the expression 



like: 



— Uc 



(43) 



where — u c is a maximum for fl3~T|), (|38|) , (|2"T|) in the case h > J 2 or for (0), (p8|), ( p8|) in 
the case h < J 2 . The function ^3(11) is defined by the corresponding term in (f42l). It is 
like a step function in the point u c . When the dominant is (^) we get: 



J $> 2 {u) < 1 - exp 
-00 ^ 

—00 

1- / $,(«)- 
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N(3 2 (l + y 2 ) 



^2{u) exp 



+ N]n2(l + h) 



u 



N(3 2 (l + y 2 ) 



+ JV In 2(1 + h) 



(44) 



For the function ^(w): it's equals to unity in the vicinity of the point — (Jq + Jq)/NB, 
further it falls exponentially. 



1 N(3 2 (l + y 2 ) j u + (Jl + J 2 )N(5 2 
exp < 



(45) 



^ 2 \u+{Jl+Jt)NP\ { Nf3 2 (l + y 2 ) 

The expression fl44]) can be substituted by ( ^4|) lies when the asymptotic (|5|) is correct. 
At last we obtain for the magnetization: 



4 + Jo + \ (1 + (m + h) In 2 , 
1 - aexp <( ^- ^ N ^ 9 



1 + J 2 



T 1 4- 7 



VT+J 2 ^ 



1 2J(l+/i)ln2 



—6 exp 



1 + J 2 



+ ATm2(l + fe)W- ^=^ -2y / (i+~fc) ln2^ 



It's correct, when: 



1 + J 2 )(l + h) ln2 > J X + JV/iln2 



1 + J 2 )(l + Mn2 > J 2 + V/iln2 
If the inequality ([4~7|) or ( f4~8l) is violated, we have: 

1 - a exp {(-Jq 1 - Vh ln2) 2 A^}^(-J 1 + 2VMn2) 
-b exp {-UJ 1 ) 2 + Mn2iV} 6 [j 1 - 2v / Mn~2 



(46) 

(47) 
(48) 



(49) 
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for 



Jo 1 + M1e2 > yj(l + J 2 )(l + h) In 2 
Jo 1 + Jy/h In 2 > J 2 + VMn2 



(50) 



or 



1 -frexp j-(^) 2 + Mn2ivj# 



^ -2v / Mii2) 



( 72 ^1 I" 72 

-a cxp 

Vh\n2) 2 N \ d \—j + 2 ^ hln2 



(51) 



for 



(52) 



J 2 + Vh\n2 > + J 2 )(l + h)\n2 
Jl + J\fhW2 > 4 + JVMn2 
Similarly we can consider the situation for J 2 > /i. 

We see (come to the conclusion) that for T = there are many subphases, where 
there are different modes (regimes) of finite size effects. 

Perhaps it will be possible to apply Derrida's model generalizations for the more compli- 
cated problems of information theory like broadcast channels. 
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